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Rajat  K.  Deb 

We  consider  the  problem  of  determining  the  optimal  operating  policy 
of  a two  terminal  shuttle  with  fixed  capacity  Q < w.  The  passengers 
arrive  at  each  terminal  according  to  Poisson  processes  and  are  transported 
by  a single  carrier  operating  between  the  terminals.  The  interterminal 
travel  time  is  a positive  random  variable  with  finite  expectation.  Under 
a fairly  general  cost  structure^  we  show  that  the  policy  which  minimizes 
the  expected  total  discounted  cost  over  infinite  time  horizon  has  the 
following  form:  Suppose  the  carrier  is  at  one  of  the  terminals  with  x 
number  of  waiting  passengers  and  suppose  that  y number  of  passengers 
are  waiting  at  the  other  terminal.  Then  the  optimal  policy  is  to  dispatch 
the  carrier  if  and  only  if  x > G(y),  where  G(y)  is  a monotone  decreasing  j 

control  function.  Furthermore^  G(y)  is  always  less  than  or  equal  to  the 
carrier  capacity  Q.  This  control  function  can  be  approximated  by  the 
linear  functions  G(y)  = K - py. 
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optimal  dispatching  of  a finite  capacity  shuttle 


Rajat  K.  Deb 


1.  Introduction 

We  consider  the  problem  of  determining  optimal  control  policies  for 
operating  a shuttle  service  between  two  terminals.  The  passengers  arrive 
at  these  terminals  (numbered  0 and  1)  according  to  independent  Poisson 
processes  X(  t)  and  Y(t)  with  respective  arrival  rates  and 

The  carrier  that  shuttles  back  and  forth  between  the  terminals  has  a 
capacity  Q < oc.  The  interterminal  travel  times  assumed  to  be  independent 
random  variable  with  identical  distribution  B(*)  and  are  independent  of 
everything  else.  All  arriving  passengers  wait  to  be  transported  to  the 
other  terminal  where  they  exit  the  system.  The  system  is  reviewed  at 
those  points  in  time  when  either  the  carrier  has  just  arrived  at  one  of 
the  terminals^  or  when  the  carrier  is  waiting  at  one  of  the  terminals  and 
a new  passenger  arrives.  The  next  arrival  may  take  place  at  either  of 
the  terminals.  The  state  of  the  system  is  denoted  by  (x^y^b)  where  x 
is  the  number  of  passengers  at  terminal  0^  y is  the  number  of  passengers 
at  terminal  1^  and  6 is  respectively  0 or  1 according  to  whether 
the  carrier  is  at  terminal  0 or  1 respectively.  At  each  review  point  and 
only  at  these  points,  one  of  the  following  actions  is  taken:  ( 1)  the 
carrier  is  dispatched  with  a batch  of  passengers  (when  x customers  are 
at  the  terminal  this  batch  equals  xAQ  s min{x,Q)),  or  (2)  the  carrier 
is  not  dispatched.  Note  that  upon  taking  action  (1)  or  (2)  the  next 
control  action  is  taken  when  the  carrier  arrives  at  the  other  terminal 
or  when  next  passenger  arrives  at  terminal  0 or  1. 
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Costs  are  charged  for  carrying  the  passengers  and  holding  the 
passenger  in  the  system.  The  cost  of  carrying  y passengers  is  R+cy, 
where  R and  c are  non-negative  constants.  The  cost  of  holding  x 
customers  is  hx  per  unit  time.  Without  loss  of  generality  we  assume 
that  no  holding  is  charged  for  those  passengers  who  board  the  carrier 
before  it  leaves  the  terminal. 

Our  objective  is  to  find  a control  policy^  that  is^  a sequence  of 
decision  rules  for  selecting  actions  (1)  and  (2)  at  each  review  pointy 
vrfiich  minimizes  the  expected  discounted  cost  over  an  infinite  time  horizon. 
Optimal  control  policy  for  the  discounted  cost  case  is  presented  in 
Section  i)-  (Theorem  i)-.2).  The  optimal  policy  is  of  the  form:  Suppose 
(Xq,  Xj^^  &)  be  the  state  of  the  system  at  a review  point.  Then  the 
optimal  policy  is  to  dispatch  the  carrier  if  and  only  if  Xg  > ^6^*1 
where  Gg(Xj^  g)  is  a monotone  decreasing  control  function. 

There  has  been  relatively  little  published  work  on  shuttles  with 
stochastic  arrivals.  Deb  and  Serfozo  [2]  determined  optimal  dispatching 
rules  for  a one  terminal  system.  Ignall  and  Kolesar  [4]  extended  a one 
terminal  system  to  a two  terminal  system  with  infinite  capacity^  where 
dispatching  decision  is  made  only  at  one  of  the  terminals.  They  conjectured 
that  a finite  capacity  shuttle  will  have  an  optimal  control  rule  of  the 
same  form.  Barnett  [l]  compares  the  average  number  waiting  in  the  system 
for  several  control  policies.  In  [6]  Ignall  et  al.  have  suggested  a way 
of  computing  the  average  queue  size  and  the  average  number  of  trips  for 
an  infinite  capacity  shuttle  under  a simple  dispatching  rule  based  on 
the  total  number  of  passengers  in  the  system.  Our  analysis  differ  from 
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others  in  the  sense  that  we  consider  a more  realistic  finite  capacity 
model  and  allow  the  dispatching  decisions  to  be  made  at  both  the  terminals. 

It  is  interesting  to  note  that  the  finite  capacity  shuttle  model  is 
also  applicable  in  the  cases  wliere  a single  server  attends  two  queues  as 
in  the  case  of  multiplexing  and  some  special  cases  of  multiprogramming. 

In  these  cases  the  server  alternates  her  services  between  the  two  queues. 

2.  Preliminaries 

The  notation  of  this  section  is  used  throughout  this  paper.  We  let 
X(  t)  and  Y( t)  denote  the  number  of  arrivals  in  time  t at  terminals 
0 and  1 respectively.  Set  Z(  t)  = X(  t)  + Y(t)  and  A = + Aj^. 

Then  Z( t)  is  a Poisson  process  with  intensity  A.  Let  the  random 
variables  and  respectively  denote  an  arbitrary  interterminal 

travel  time  and  arbitrary  passenger  interarrival  times  at  the  terminals 
0 and  1.  The  random  variables  t,  and  have  respective  distri- 

butions 1 - exp(-AQt),  1 - exp(Aj^t)  and  B(  t) . Writing  | = mind^^ip, 
it  can  be  seen  that  the  random  variable  | has  the  distribution  1 - exp(-At). 
Let  V(x,y^6)  be  the  optimal  O-discounted  cost  over  the  infinite  time 
horizon  with  continuous  discounting  factor  a and  initial  state  (x,y,&). 

Note  that  herein  we  supress  the  effect  of  the  discount  factor  <X  on  V. 

Since  the  cost  of  never  dispatching  the  carrier  is 

00 

(2.1)  E / exp(-at)  h(x+y+Z(  t))dt  = h(x+y+A/ci:)/a  < » ^ 

0 
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the  a-diacounted  cost  V{x,y,6)  < h{x+y+)\/a.)/a.  Using  Theorem  7. 1 of  [7], 
which  also  holds  for  semi-Markov  processes  with  unbounded  costs^  we  obtain 
the  following  optimality  equation 


(2.2)  V(x,y,6)  = min{f(x,y,6),  g(x,y,5) } , 

where  f is  the  cost  of  not  dispatching  the  customer,  and  holding  the 
waiting  customers  for  a time  ^ until  the  next  arrival  before  taking  the 
next  action.  g(x,y,  6)  is  the  cost  of  dispatching  the  carrier  from  the 
terminal  6,  carrying  the  passengers,  holding  the  excess  passengers  (if 
any)  and  the  new  arrivals  for  a period  t,  after  which  another  action  is 
taken  with  the  system  in  state  (x+X(t)  - (l-6)xAQ,  y+Y(T)  - &(yAQ),  1-&) . 
Clearly, 

(2.3)  f(x,y,6)  = E{/  e"^*^  h(x+y)dt  + e‘°^  V(x+X(|),  y+Y(|),  6)) 

0 

= H(x+y)  + apV(x+l,y,6)  + aqV(x,y+l,6)  , 

where 

H(x)  = E / h(x)dt  = hx/(Q^^-^)  , 

0 

a = E{exp(-Q;|))  = V(Ctf^)  , 
p = P[X(|)  = 1]  = P[Y(|)  = 0]  = V^V^l^  ^ 
q = P[X(|)  = 0]  = P[Y(0  = 1]  = 1-p  , 

and 


k 


(2.1).)  g(x,y,0)  = R + c(xAQ)  + E(/  e"  h(x+y-xAQ+Z(  t))dt 

0 

+ e V(x-xAQ+X( t) ,y+Y( t) , 1)) 

= R + c(xAQ)  + H(x+y-xAQ)  + E d. . V(x-xAQ+j,y+i- j, 1) , 

i>0,0<j<i  ^ 


(2.5)  g(x,y,l)  = R + c(yAQ)  + H(x+y-yAQ) 


+ E d V(x+j,  y-yAQ+i-j,  0)  , 

i>  0,0<  j<  i 


where 


E / e”*^*"  h(x4-Z(t))dt 


p 1 -Qt 

= (l-b)hx/a  + hA(l-b)/a  - hAa"  / te  dB(  t)  , 

0 


b = E(exp(-aT) },  d^  = a q , 


^0 


Li:e-(°^^)^dB(t)  , q.  . = (j)  . 


Note  that  {p.}  and  probability  mass  functions^  ^‘^ij  ~ P^  “ 

Whenever  both  the  terms  on  the  right  of  (2.2)  are  equal^  that  is  f = g, 


we  write 


(2.6) 


V(x,y,&)  = f(x,y,6)  . 


Also  note  that  from  the  definition  of  H and  H it  follows  that 
(2.7)  H(x)  + aH(x+l)  = H(x)  + Ed  H(x+i)  = il(x)  + E H(x+i) 


In  addition^  for  any  function  w(x^y^z)  we  define  the  difference  operator 
A as  follows 


For  the  linear  functions  H and  we  define 


(2.9)  AH  = H{x)  - H(x-l)  = (l-a)h/a  and  AH  = (l-b)h/a 


We  approach  the  problem  of  finding  an  0!-optimal  using  the  finite  horizon 
n-period  problem  which  we  define  in  the  equation  (2.10).  We  show  that 
for  each  n and  hence  in  the  limit  a monotone  policy  of  the  form  described 
in  Section  1 is  optimal.  We  present  these  policies  in  Theorem  4.2.  The 
n-period  problem  is  defined  as  follows.  Let 


(2.8) 


= w(x,y,z)  - w(x-l,y,Zj^)  , 
^Wj^(x,y,z)  = w(x,y,z)  - w(x^y-l,z)  . 


V (x,y,6)  = h(x+y+Va)/Q!  , 


(2.10) 


where 


(2.11) 


(2.12) 


(2.15) 


/ 

I V*" 


(x,y,6)  = min{f''(x,y,&),  g''(x,y,6))  , 


f"(x,y,5)  = H(x+y)  + apv'^"\x+l,y,6)  + aqv""\x,y+l,5)  , 

8’^(x,y,0)  = R + H(x+y-xAQ)  + c(xAQ)  + Sd^^  v"‘\x-xAQ+j,  y+i-j,l), 
8"(x,y, 1)  = R + H(x+y-yAQ)  + c(yAQ)  + Sd^^  v"‘^(x+j,  y-yAQ+i- j,0) . 


The  summation  on  d^^  is  taken  over  all  i > 0 and  0 < j ^ 1.  We  can 
consider  v”  as  the  cost  of  operating  the  system  for  n review  periods 


and  incurring  a final  cost  V at  the  end  of  the  n-th  period.  Note  that 
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if  the  n-th  review  takes  place  at  t , then  t » as  n -» oo  and  the 
cost  V discounted  to  time  0 is  < E{exp(-at^  h( x+y+Z(  t^) ) } 

= E{exp(-(^t^)  h(x+y+X(t^)]  0 as  n Furthermore^  increases 

monotonically  with  n^  because  if  ^ then  one  can  decrease  v''  ^ 

by  using  the  n- period  policy  for  the  (n-1)- period  problem.  Moreover,  from 
(2.1)  we  get  h(x+y+V'^)/ci!  > ^(x,y,&)  > 0 and  hence  t V 

as  n -»oo.  Now  using  the  Theorem  6.12  of  [7]  (which  also  holds  for  dis- 
counted semi-Markov  processes)  or  more  appropriately  Theorem  2.2  of  [9], 
we  assertain  that  the  stationary  policy  which  satisfies  equation  (2.2) 
is  optimal.  Note  that  in  [8,9]  the  problem  is  set  up  for  maximization, 
while  we  are  minimizing  the  total  expected  costs.  If  we  take  this  into 
account,  then  it  is  easy  to  show  that  the  conditions  A1  and  A2  of  [9]  are 
satisfied  and  hence  the  Theorem  2.2  of  [9]  holds.  As  a consequence  of 
convergence  of  to  V,  we  conclude  that  f*^  -»  f and  g*^  g. 

5.  n-Period  Problem 

In  this  section  we  consider  the  n-period  problem  defined  in  (2.10) 
and  obtain  results  similar  to  those  of  [3]-  Without  loss  of  clarity,  we 
shall  often  drop  the  subscripts  and  arguments  of  the  functions  defined 
in  (2.2)  - (2.15).  For  Instance,  the  statement  AV^  > Ag  will  stand 
for  the  statements  ^VQ(x,y,&)  > Ag”(x,y,&)  and  Av”(x,y,6)  >Ag’^(x,y,5) 
for  all  X,  y,  and  &. 

Lemma  3.1.  Let  Af^  > Ag*^.  Then 
(i)  Av"<Af". 

(ii)  Av''>Ag". 
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Proof.  Clearly^  (2.10)  implies  v"  < v"  < and  for  any  y and  6 
either 

(3.1)  V"(x,y,5)  = f"(  .y,6) 
or 

(3.2)  v"(x,y,5)  = g'^(x,y,6)  . 

If  (3.1)  holds^  then 

(3.3)  '^VQ(x+l,y,6)  < Af^(x+l,y,&),  AvJ(x,y+l,6)  < Af^(x,y+1,&)  , 
and 

(3.4)  Av''(x,y,S)  > Af”(x,y,S)  > Ag"(x,y,&)  . 

And  if  (3.2)  holds^  then 

( ^VQ(x+l,y,6)  < Ag”(x+l,y,6)  < Af^(x+l,y,&)  , 

(3.5) 

( AV^(x,y+l,6)  < Ag"(x,y+1,6)  < Af^(x,y+1,6)  , 

and 

(3.6)  Av"(x,y,&)  >Ag''(x,y,B)  . 

Now^  combining  (3.3)  (3.5),  we  have  Av"  < Af''.  From  (3.^)  (3.6) 

we  obtain  AV*^  > Ag". 

Leinna  3.2.  Let  Af*^  > Ag*'  and  suppose  that  for  all  x,y  and  & 

(3.7)  ^fo^x,y,B)  > Af^(x,y+1,6),  Af"(x,y,&)  > Af^( x+l,y,&)  , 

(3.8)  ^g^(x,y,&)  > Ago(x,y+l,&)  and  Ag"( x,y,6)  > Ag"( x+l,y,&)  . 
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Then 


(i)  AVp(x,y,6)  > AVQ(x,y+L,B), 

(ii)  Av"(x,y,6)  > Av"(xi.l,y,6). 

Proof:  The  proof  is  similar  to  that  of  Lenina  3. f • Suppose  (3.1)  holds^ 

then  using  the  fact  V < f^  inequality  (3.7)  the  Lemma  3-1,  iri  that 

order^  we  have 

I AVQ(x,y,5)  >Ayx,y,&)  > AfJ(x,y+l,6)  > AVq( x,y+l,6)  , 

(3.9) 

V Av"(x,y,&)  >Af”(x,y,5)  > Af"( x+l,y,6)  > AV^(x+l,y,6)  . 

And  if  (3.2)  holds  then  using  the  fact  V < g^  (5.8)  and  the  Lemma  3.1 
we  obtain 

I ^VQ(x,y+l,&)  < AgQ(x,y+l,6)  <Ag”(x,y,5)  <AvJ(x,y,6)  , 

(5.10)  j 

( Av”(x+l,y,5)  < Ag^(x+l,y,6)  <Ag^(x,y,6)  <Av"(x,y,&)  . 

This  completes  the  proof. 

Theorem  3.3.  If  h > a( c + R/Q)  then  for  all  x,  y and  n > 1 
(i)  Af">Ag'", 

(ii)  AVQ(x,y,&)  > AVQ(x,y+l,5), 

(iii)  Av"(x,y,6)  > Av"(x+l,y,&), 

( iv)  AV*'  > c. 
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Proof:  We  prove  this  Theorem  by  induction.  Using  the  definition  of  Af'' 
and  Ag'^j  we  have  for  n = 1 

(5.11)  Af^  = + ah/a  = (l-a)h/a  + ah/a  = h/a  . 

From  the  definition  of  H and  the  fact  Zd  . = b we  have 

ij 

(5.12)  Ag^(x,y,  1)  = Ag|^(x,y^O)  = AH  + Zd^^  h/a  h/a  ^ 
and 

/C  for  & = 0,  X < Q (&=1,  y < Q), 

(3.15)  Agg(x,y,6)  J 

ah  + 2d^^  h/a  = h/a  for  6 = 0,  x > Q (6=1,  y > Q)  . 
Since  h >a(c  + R/Q),  therefore  (5,11)  - (5.15)  imply 

(5.U)  Af^>Ag^  . 

Moreover,  using  (5.11)  - (5.15)  it  is  easily  varified  that  the  conditions 
(5.7)  (3.8)  of  the  Lemma  5.2  are  satisfied  and  hence  parts  ( i)  , (ii) 

and  ( iii)  of  the  Theorem  5.5  sre  true  for  n = 1.  To  prove  part  ( iv)  note 
that  from  (5.1^),  Lemma  5.1,  (5.12)  and  (5.15)  we  have 

(3.15)  ^V^>Ag^>| 

( h/a  > c 

Now,  assuming  that  the  Theorem  is  true  for  all  n ^ k,  then  for  n = k+1, 
we  have 
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(5.1b)  Ag^'*’^(x,y,0)  = AH  + AV^(x-xAQ+j,  y+i-j,  1) 

< AH  + Af^(x-xAQ+j,  y+i-j,  1) 

= ah  + Ed^j{AH  + ap  AV^~ x-xAQ+j+1,  y+i-j,  1) 

+ aq  AV^‘^(x-xAQ+j,  y+l+i-j,  1)} 

<AH  + Ed^^  AH  + aEd.^([AV^'^(x+l-(x+l)AQ+j,  y+i-j,  1) 
+ qAV^'^(x-xAQ+j,  y+l+i-j,  1)} 


= AH  + 

ap{AH  + Sd^j  AV^‘ 

^(x+l-(x+l)AQ+j,  y+i-j,  1)3 

+ 

aq{AH  + Ed^j  AV^' 

^(x-xAQ+j, 

y+i-j+1,  1} 

11 

+ 

ap  Ag^(x+l,y,0)  + 

aq  ^8^(x, 

y+1,0) 

< AH  + 

ap  AV^(x+l,y,0)  + 

aq  AV^(x, 

y+1,0) 

= Af^'^\x,y,0)  . 

The  lines  1,  3,  6 and  8 of  (3.16)  follows  from  the  definitions  of  Ag  and 

k k k k 

Af.  Lines  2 and  7 follows  from  the  fact  that  AV  < Af  and  Ag  < AV  . 
Also  note  that  for  x > Q,  x-xAQ+1  = (x+1)  - (x+l)AQ  and  for  x < Q-1, 
x-xAQ  = (x+1)  - (x+l)AQ.  Therefore,  for  x < Q-1  line  L equals  line  5 
and  for  x > Q,  we  obtain  line  L by  using  the  induction  hypothesis 
AV^"^(x+l,y, 1)  < AV^' ^(x,y, 1)  for  all  x and  y.  Finally,  line  5 can 
be  obtained  from  (2.7)  by  noting  that  p+q  = 1.  Using  symmetry  and 
arguments  similar  to  those  used  in  (3.I6)  we  obtain 


(5.17) 


AgQ'^\x,y,l)  < AfJ-^\x,y,l)  . 

Moreover^  from  (2.9)  and  the  induction  hypothesis  AV  > c we  have  for 
X < Q 

k-i-l 

(5.18)  Ag^  (x,y,0)  = c = (l-a)c  + ac  < (l-a)h/a  + c 

= AH  + ape  + aqc  < AH  + ap  AVQ(x+l^y^O)+aq  Av''^(x,y+1,0) 

For  X > Q,  using  the  fact  that  AV^  < Af*^^  Ag*^  < AV*^,  definitions  of  Af 
and  Ag^  and  the  quality  (2.7)  we  have 

(5.19)  Ag*+  (x,y,0)  = AH  + Ed.j  AvJ(x-Q+j,  y+i-j,  L) 

<AH  + Ed^.  AfJ(x-Q+j,  y+i-j,  1) 

= ah  + Ed.j  AH  + Ed^j{ap  AV^' \x-Q+l+j,  y+i-j,  1) 

+ aq  AV^'^(x-Q+j,  y+i-j  + 1,  1)} 

= AH  + ap(AH  + Ed.j  AV^' \x-Q+l+j,  y+i-j,  1)) 

+ aq{AH  + Ed.^  AvJ*^(x-Q+j,  y+l+i-j,  1)} 

= AH  + ap  Agj(x+l,y,0)  + aq  Ag^(x,y+1,0) 

<AH  + ap  AVQ(x+l,y,0)  + aq  AVQ(x,y+l,0) 

= . 
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* < 


Combining  (5.18)  and  (5.19)  we  obtain  x, y^O)  < ^fQ^^(x,y,0)  using 

arguments  similar  to  those  used  in  (5.18)  and  (5.19)  we  can  show  that 
Ag^‘*‘^(x^y^  1)  < Af^‘'’^(x^y,  1)  and  hence 


(5.20) 


To  prove  parts  ( ii)  and  (iii)  of  this  theorem  it  is  sufficient  to  show 
that  the  condition  (5.7)  (5*8)  of  the  Lemma  5.2  are  satisfied.  Using 

the  induction  hypothesis  and  definition  of  Af  we  have 


If  » 1 If  If 

+ ap  AVQ(x+l,y+l,5)  - aq  AVQ(x,y+2,5) 
<AH  + ap  AV^(x+l,y,6)  + aq  AV^(x,y+l,5) 


k+l  k k 

Af^^  (x+l,y^5)  = AH  + ap  AVj^(x+2^y^&)  + aq  AVj^( x+l,y+1^6) 

< AH  + ap  AV^(x+l,y,5)  + aq  AV^(x^y+l,5) 


= AfJ(x,y,6)  . 

To  prove  (5.8),  note  that  for  5=0,  x<Q,  y > 0 


(3.21) 


AgQ^\x,y,5)  = c , 


and  for  6=0^  y>0  and  6 = 1^  * ^ 0^  y ^ using  the  fact 

^VQ(x,y+l,6)  for  all  x,  y and  we  have 


k+l  - k 

(3.22)  AgQ+\x,y+l,&)  = AH  + Zd  Vq(x-(  l-&)Q+j,  y+l-5(y+l)^+i- j,  1-6) 


<AH  + Zd^^  VQ(x-(l-&)Q+j,  y-6(yAQ)+i-j,  1-6) 


= AgJ"-\x,y,&) 


Therefore^  using  (5.21)  and  (3.22)  we  obtain 


(5.23) 


^go'^\x,y,6)  > AgJ‘^’-(x,y+l,6) 


Using  arguments  similar  to  those  used  in  (3.23)  we  obtain 


(3.24) 


Ag^'^^(x,y,6)  > Ag^'^\x+l,y,6) 


Finally  to  prove  part  ( iv)  of  this  theorem^  we  note  that  (3.20)  implies 
that  the  Lemma  3.1  is  true  for  n = k+1  and  hence 


(3.26)  AV*^'^^(x,y,&)  > Ag*^'^\x,y,6) 


for  & = 0,  x<Q(6  = 1^  y<Q)  , 


= ah  + Sd^j  AV  (x-(l-6)Q+j,  y-6Q+i-j^  1-6)  otherwise 


> ah  + Ed^jC  > c , 


The  last  line  in  the  above  is  obtained  from  the  induction  hypothesis  and 
the  fact  that  h/0£  > c.  This  completes  the  proof. 
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Lenma  3 ■ ^ . Let  h >Q;(c  + R/Q).  Then 
(i)  v"(x,y,0)  = g''(x,y,0)  for  all  x > Q, 

(ii)  V"(x,y,l)  = g"(x,y,l)  for  all  y > Q. 

Proof.  From  (2.10)  - (2.13)  we  have 

(3.26)  f^(x,y,6)  = H(x+y)  + ah(x+y+l  + ^)/Q! 

= h(x+y+  'K/a)/a  ^ 

and  from  & = 0^  writing  e = xAQ  we  have 

(3.2f)  8^(x,y,0)  = R + ce  + H(x+y-e)  + Zd^j(x+y-e+i+?\/0!)h/Q:  • 

From  definition  of  H(x)  we  have 

00 

(3.28)  H(x)  = (l-b)hx/a  + {(l-b)/a  - / t exp(-at)  dB(t))  KKja 

0 

= (l-b)hx/Q:  + {A(l-b)/a  - z n a"  p^)  h/a 

/ 

= (l-b)hx/a  + (A(l-b)/a  - z h/a  . 

Using  (3.27),  (5.28)  and  noting  that  Ed^^  = b,  we  have 
g^(x,y,o)  = 


(5.29) 


(R  + ce  - he/ Of)  + (x+y+Va)  h/a  . 


If  X > Q,  then  e = Q,  and  using  the  fact  h > Ot{c  + ^/Q),  we  have 
g^(x,y,0)  < f^(x,y,0).  Hence  V^(x,y,0)  = g\x,y,0).  Now,  suppose  that 
for  all  x > Q and  n < k,  f'^(x,y,0)  > g*'(x,y,0)  and  consequently, 
V*^(x,y,0)  = g*'(x,y,0).  Then  using  the  induction  hypothesis,  equation  (2.7) 
and  the  fact  h > Ct(  c + R/Q),  we  have 

^ , 1 If  Ic 

f (x,y,0)  = H(x+y)  + ap  V (x+l,y,0)  + aq  V (x,y-Hl,0) 

= H(x+y)  + ap(R  + H(x+y+l-Q)  + cQ 

+ Ed^j  v'^'^(x+l-Q+j,  y+i-j,  1)) 

+ aq{R  + H(x-f-y+l-Q)  + cQ 

+ Ed^j  v'^'^x-Q+j,  y+l+i-j,  1)) 

= H(Q)  + H(x+y-Q)  + a(R+cQ)  + Ed^^ {H(x+y+l-Q+i) 

+ ap  V^”\x+l-Q+j,  y+i-j,  1) 

+ aq  v’^'^x-Q+j,  y+l+i-j,  1)} 

> H(Q)  - (1-a)  (R+cQ)  + R + cQ  + H(x+y-Q) 

+ Ed.^  V^x-Q+j,  y+i-j,  1) 

= (1-a)  Q{h/a  - c - R/Q)  + g''^\x,y,0) 

> g*^'^^(x,y,o)  . 

For  6=1  and  y > Q,  the  proof  is  analogous. 

Lemma  3.3.  Let  h < Ci[(c  + R/Q)  . Then  for  all  x > 0,  y > 0 and  6 € {0,1} 
v"(x,y,6)  = f'^(x,y,8)  = (x+y+Vo!)  h/a  . 
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Proof.  Using  (^.26)  - (3-29)  and  letting  e = x for  5=0  and  e = y 
for  & = Ij  we  have 


i 


= (x+y+va)  h/a 

and 

g^(x^y,&)  = R + c(eAQ)  - h(eAQ)/a  + (x+y+TyCt)  h/a  . 


Note  that  h(eAQ)  < c( eAQ)  + R(eAQ)/Q  < c(eAQ)+R.  Hence  g^(x^y^O) 

> f^(Xjy,0)  = (x+y+VQ!)h/Q:  = V^(x^y^O).  Now,  suppose  that  the  Lemma 
is  true  for  all  n < k.  Then  for  n = k+1, 

g*^'^^(x,y,0)  = R + c(xAQ)  + H(x+y-xAQ)  + Ed^j  V*^(x-xAQ+j,  y+i-j,  1) 

= R + c(xAQ)  + H(x+y-xAQ)  + Sd^j(x+y-xAQ+i+VQ!)h/Ci! 

k . 1 

> (x+y  !-VQ!)h/a  = f (x,y,0)  , 

Similarly  one  can  show  that  g^'*'^(x,y,  1)  > f'^^^(x,y,  1)  = (x+y+A/Q!)  h/a. 
Hence  v'^(x,y,6)  = f"(x,y,&)  = (x+y+A/Cc)  h/a  for  all  n > 1. 


( 


Optimal  Discounted  Cost  Policj 


In  this  section  we  present  the  main  results  of  this  paper.  These 


results  are  obtained  directly  from  the  leinnas  and  the  Theorem  of  the 
Section  3.  We  summarize  these  results  in  the  following  corollary. 


( i)  If  h < a(c  + R/Q),  then  for  all  x,  y and  6 


v(x,y,&)  = f(x,y,&)  = (x+y+A/o:)  h/a  . 


(ii)  If  h > a(c  + R/Q),  then 

(a)  Af  > Ag,  AV  < Af , AV  > Ag; 

(b)  AVQ(x,y,6)  > AVQ(x,y+l,&),  AV^(x,y,6)  > AV^( x+l,y,6) ; 

(c)  AV  > cj 

(d)  For  all  x > Q,  y > 0 and  6=0  (x>0,  y>Q,  6=1) 

V(x,y,6)  = g(x,y,6). 


From  the  comments  at  the  end  of  Section  2,  we  know  that  -» V,  g 

and  f^  -*  f,  and  hence  Av"^  -»AV.  Therefore,  Ij..  1(  i)  follows  from  the 
Lemma  5.5.  Parts  (a),  (b)  and  ( c)  of  the  Corollary  h.l(ii)  come  from 
Theorem  5.5  and  Lemma  5.1.  Finally,  part  (d)  in  the  above  is  obtained 
from  Lemma  5.^. 


Theorem  h.2. 

( i)  If  h < 0^ c + R/Q),  then  the  policy  of  never  dispatching  the 
carrier  is  Ct-optimal  and  V(x,y,6)  = h{x+y+7\/cc)/(X. 

( ii)  Let  h >a(c  + R/Q)  and  (x,y,5)  be  the  state  of  the  system. 
Then  for  6 = 0 (6  = 1),  there  is  a critical  number  ^^(y)  < Q (Gj^(x)  < Q) , 
such  that  following  is  an  optimal  policy: 
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Dispatch  the  carrier  if  x > GQ(y)  (y  > Gj^(x;)  and  wait 
for  the  next  arrival  if  x < G^Cy)  (y  < Gj^(x))  , 

Furthermore^  ^0^^^  respectively  monotone  decreasing 

functions  of  y and  x. 

Proof.  The  first  part  of  this  Theorem  follows  directly  from  the  Corollary 
4. 1( i)  and  the  fact  that  f(x^y,&)  is  the  cost  of  the  action  of  not 
disptaching  the  carrier. 

Now^  we  prove  the  second  part  of  the  theorem  for  6=0.  The 
proof  for  the  case  6=1  is  similar  to  the  case  6=0.  Let  y be 
fixed  and 

(4.1)  G^(y)  = min(x  > 0 : f{x,y,0)  > g(x^y,0))  . 

From  the  Corollary  4.1(ii)(d)j  it  follows  that  for  all  x > Q 
f(x,y,0)  > g(x,y,0)  = V(x,y,0)  and  hence  G^iy)  < Q.  Now,  it  suffices 
to  show  that 

(4.2)  V(x,y,0)  = g(x,y,0)  for  all  x > GQ(y)  . 

We  establish  the  validity  of  (4.2)  by  induction.  Clearly  (4.2)  holds 
for  X = G^(y).  Assume  that  (4.2)  is  true  for  some  x > GQ(y).  Then 
using  the  Corollary  4.1(ii)(a),  we  have 

(4.5)  V(x+l,y,0)  - V(x,y,0)  > g(x+l,y,0)  - g(x,y,0)  . 
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Then  using  (4.5)  and  the  induction  hypothesis,  which  imply  V(x,y,0) 

= g(*,y,0),  we  obtain  V(x+l,y,0)  > g(x+l,y,0).  But  from  (2.2).  We 
know  V(x,y,0)  < g(x,y,0)  and  hence  V(x+l,y,0)  = g(x+l,y,0).  Again 
from  the  definition  (4.1)  of  ^^(y),  it  follows  that  V(x,y,0)  = f(x,y,0) 
for  all  X < GQ(y).  To  show  GQ(y)  is  monotonically  decreasing,  we  note 
that  due  to  the  Corollary  4.1(ii)(a),  we  have 

(4.4)  f(x,y+l,0)  - f(x,y,0)  > g(x,y+l,0)  - g(x,y,0) 
and  from  (4.1)  we  get 

(4.5)  f(sy^O)  > for  all  x>G^(y)  . 

Combining  (4.4)  and  (4.5),  we  get  f(x,y+l,0)  > g(x,y+l,0)  and  hence 
GQ(y+l)  < GQ(y).  This  completes  the  proof. 

Since  the  control  function  G is  non- increasing,  we  can  approximate 
G by  a linear  function.  The  family  of  monotone  decreasing  linear  functions 
have  the  form 


^0^^)  " ^1^*^  " where  0 < < K^,  i = 0,  1 

In  this  case  the  approximately  optimal  policy  is  completely  determined 
by  the  critical  numbers  (K^,  p^,  Kj^,  P^)  . Such  simple  policies  are 
ideally  suited  for  practical  applications.  The  values  of  these  critical 
constants  can  be  determined  by  standard  methods  of  calculus  [2,3].  Some 
methods  for  computing  these  constants  for  “ ^1  “ ^ also  be  found 

in  [6].  For  small  Q,  one  can  obtain  the  values  of  G by  direct  enumeration 
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because  G < Q.  We  hope  to  present  some  exact  and  approximate  methods 
for  computing  G in  the  near  future. 

Finally,  one  can  show  that  the  Theorem  4.2  is  valid  for  Q = +00. 
However,  in  this  case  the  Lemma  3.4  and  Corollary  4.1(ii)(d)  are  invalid. 
The  fact  that  G < « can  be  established  by  the  method  given  in  the 
Lemma  3.2  of  [2].  One  can  also  readily  extend  these  results  for  non- 
linear holding  costs. 


I 
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